WORLD INTELLECTUAL PROPERTY ORGANIZATION 
International Bureau 




PCT 

INTERNATIONAL APPLICATION PUBLISHED UNDER THE PATENT COOPERATION TREATY (PCT) 



(51) International Patent Classification 7 : 
G06F 9/24 



A2 



(11) International Publication Number: WO 00/52570 

(43) International Publication Date: 8 September 2000 (08.09.00) 



(21) International Application Number: PCT/USOQ/05674 

(22) International Filing Date: 2 March 2000 (02.03.00) 



(30) Priority Data: 
60/122,591 
60/122,594 
60/122,595 



3 March 1999 (03.03.99) US 
3 March 1999 (03.03.99) US 
3 March 1999 (03.03.99) US 



(71) Applicant: CIVON CORPORATION [US/US); 2336H Walsh 

Avenue, Santa Clara, CA 95051 (US). 

(72) Inventors: PANG, Joseph; 2336H Walsh Avenue, Santa Clara, 

CA 95051 (US). TENG, Peter; 2336H Walsh Avenue, Santa 
Clara, CA 95051 (US). 

(74) Agents: TITUS, Carol, D. et al.; Leary & Associates, 505 W. 
Olive Avenue, Suite 330, Sunnyvale, CA 94086 (US). 



(81) Designated States: AE, AL, AM, AT, AU, AZ, BA, BB, BG, 
BR, BY, CA, CH, CN, CR, CU, CZ, DE, DK, DM, EE, 
ES, FI, GB, GD, GE, GH, GM, HR, HU, ID, IL, IN, IS, JP, 
KE, KG, KP, KR, KZ, LC, LK, LR, LS, LT, LU, LV, MA, 
MD, MG, MK, MN, MW, MX, NO, NZ, PL, PT, RO, RU, 
SD, SE, SG, SI, SK, SL, TJ, TM, TR, TT, TZ, UA, UG, 
UZ, VN, YU, ZA. ZW, ARIPO patent (GH, GM, KE, LS, 
MW, SD, SL, SZ, TZ, UG, ZW), Eurasian patent (AM, AZ, 
BY, KG. KZ, MD, RU, TJ, TM), European patent (AT, BE, 
CH, CY, DE, DK, ES, FI, FR, GB, GR, IE, IT, LU, MC, 
NL, PT, SE), OAPI patent (BF, BJ, CF, CG, CI, CM, GA, 
GN, GW, ML, MR, NE, SN, TD, TG). 



Published 

Without international search report and to be republished 
upon receipt of that report. 



(54) Title: A NETWORKED CLIENT/SERVER EMBEDDED BACKBONE SYSTEM INTEGRATING OPERATING SYSTEM RE- 
MOTE-BOOTING, APPLICATION SOFTWARE PUSHING, AND CENTRAL CONTROL COMMUNICATION SOFT- 
WARE 



(57) Abstract 
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remote booting of operating system onto the embedded systems 
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A NETWORKED CLIENT/SERVER EMBEDDED BACKBONE SYSTEM 
INTEGRATING OPERATING SYSTEM REMOTE-BOOTING, APPLICATION 
SOFTWARE PUSHING, AND CENTRAL CONTROL COMMUNICATION 

SOFTWARE 

15 

FIELD OF THE INVENTION 

This application relates to a network of embedded systems that are controlled by 
20 a central server. Optional encryption and motion detection in H.263 compressed video 
stream systems are also disclosed. This application relates to motion detection in video 
surveillance equipment. More particularly, it relates to a more efficient method of 
motion detection in H.263 compressed video stream. 

25 BACKGROUND 

A traditional computer embedded system is a standalone computer system with 
its operating system and application software implemented in a PROM (Programmable- 
Read-Only-Memory). Embedded systems are devices with small computerized 

30 controllers which work in the everyday world such as thermostats, video surveillance 
cameras, automotive self diagnostics, robotic control for automated manufacturing, 
traffic lights and other household, industrial and other applications. To change or 
update the function or behavior of the embedded system requires its PROM be replaced 
with a new one manually. Standalone embedded systems are not easily controlled by a 

35 central server, and generally provide little or no flexibility and scalability of the system 
without complete replacement. 
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SUMMARY OF THE INVENTION 

To overcome the difficulties of utilizing such standalone embedded systems, a 
5 networked client/ server embedded backbone system is designed. The new networked 
embedded system has several benefits. 

The first benefit is financial savings. Each embedded system boots its Operating 
System (OS) into its RAM (Random- Access-Memory) from the central server instead of 
running from its PROM. It's application software is also pushed from the central server 
10 into the RAM after the OS is booted. There is a great cost saving because a RAM device 
is much lower in cost than the corresponding PROM device. 

The networked embedded system is also easy to use. Both the OS and 
application software are transferred from the central server when the embedded system 
is powered up. There is no need to manually change the PROM. Function modification 
1 5 and updating can be easily managed from the central server, thereby alleviating the 
need to update each embedded system manually. 

The networked embedded system is flexible to allow the user to utilize a wide 
variety of options. For example, a RAM device's larger capacity makes the selection of 
OS more flexible and application software easier to implement. A traditional 
20 standalone embedded system requires a small footprint of the OS, so the choices of OS 
are very limited. With the new design, a larger size OS such as Linux or Windows can 
be used. 

The networked embedded system is scalable. Traditional standalone embedded 

systems are severely limited by their PROM size. The application software pushing in 
25 the new design requires only a larger size of RAM so it is much easier to implement 

more complicated application software. 

The networked embedded system is reliable. Diskless OS remote booting and 

software pushing do not require any mechanical parts on the embedded system. It is as 

reliable as the traditional standalone embedded system. 
30 The networked embedded system is easily managed by the user. In addition to 

transferring OS and application software from the central server to the embedded 

systems, a central control communication software layer is provided to make a large 

number of embedded systems possible and more manageable. 

35 The present invention takes the form of a networked embedded backbone system 

that integrates three techniques to make the system better than traditional standalone 
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EPROM-based embedded systems. The first technique is remote booting of the 
operating system onto the embedded systems from a central server. Once the operating 
system is booted, the application software for the embedded systems may then be 
pushed from a central server. A generic central control communication software layer 
5 is provided for application software on each embedded system to communicate with 
the central server or other embedded modules on the network. 

BRIEF DESCRIPTION OF THE DRAWINGS 

10 Figure 1 shows the components of the present invention used a digital video 
surveillance system. 

Figure 2 shows an overview of the full system. 
DETAILED DESCRIPTION 

15 

Three techniques are integrated together to make the networked embedded 
backbone system better than traditional standalone EPROM-based embedded systems. 
The first technique is remote booting of operating system onto the embedded systems 
from a central server. Depending on the targeted operating system to be booted onto 

20 the embedded system, a small footprint of the boot ROM is programmed and installed 
on the embedded system motherboard or Network Interface Card (NIC). This small 
boot ROM program will use the BOOTP and TFTP (Trivial File Transfer Protocol) 
protocols to locate a boot server or central server on the network and request the 
loading of the boot image file from that server. 

25 On the server side, a boot server code is implemented to answer the embedded 

systems' request and to provide booting services. The boot server transfers a designed 
boot image file based on each requester's unique MAC (Media Access Control) address 
on the network interface card. After the boot image file is transferred onto the 
embedded system and executed, the final footprint of the targeted OS is then 

30 transferred and executed from the boot server to the embedded system. 

A different OS can be booted to different embedded systems based on requester's 
MAC address. This process is different for different types of OS and can go through a 
number of phases before the fully functional OS is booted onto the embedded system. 
Once the operating system is booted, the application software on the embedded systems 

35 may then be pushed from a central server. Since different OS image files can be booted to 
the embedded systems depending on requester's unique MAC address, the image of the 
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targeted OS can be setup with a special initialization process so during its execution 
phase, a different pre-packaged application software can be loaded. An embedded 
system usually handles some unique devices on that system; specially packaged 
application software for that system can be loaded and run after the OS is booted. 

5 A generic central control communication software layer is provided in the 

packaged application software for application software on each embedded system to 
communicate with the central server or other embedded modules on the network. It 
provides communication and control mechanisms among the central server application 
software and the embedded system application software, and thereby provides several 

10 services. 

The first service is advertisement, which allows an individual embedded system 
to advertise its existence after its power-up. A method of periodical multicast of data 
gram packets is used to allow each embedded system to advertise its existence and 
search for a central controlling device. 

15 A capability information exchange service allows the central server to know the 

capability information of every embedded system on the network. 

A RPC (Remote Procedure Call) service allows the central server to communicate 
and control every individual embedded system on the network. It also allows each 
embedded system to communicate and control other embedded systems on the 

20 network. 

EXAMPLE EMBODIMENT 

A digital surveillance system is implemented according to the methods described 
25 in this patent application and shown in figures 1 and 2. Figure 1 shows the components 
of the present invention used as a digital video surveillance system 10. Figure 2 shows 
an overview of the full system. 

In this implementation, the V-Hubs 12, recorders 14 and displays 16 are 
"Networked Embedded Systems". The server 18 is the central server, which, in this 
30 case, serves as the remote-boot server as well as the central controller. Hundreds of 
cameras 20 may be connected to the V-Hub 12, devices that in turn are connected to the 
Ethernet network 22. 

Linux OS and the V-Hub application are remote booted from the central server 
18 and the V-Hub application will capture each camera's video streams and multicast 
35 them onto the network 22. The V-Hub 12 embedded system has a communication/ 
control software layer implemented so that it will report its existence to the central 
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controller 18 and accept capturing commands from the central controller 18 for 
execution. 

Linux OS and the recorder application are remote-booted from the central server 
18 and the recorder application will record video streams according to the 
5 pre-programmed schedule. The recorder 14 embedded system has a communication/ 
control software layer implemented so that it will report its existence to the central 
controller 18 and accept recording schedule or commands from the central controller 18 
for execution. 

Linux OS and the display application are remote-booted from the central server 
10 18 and the display application will display any pre-programmed video streams. The 
display embedded system has a communication/ control software layer implemented so 
that it will report its existence to the central controller 18and accept displaying 
schedule or commands from the central controller 18 for execution. 

In this example, the whole "Networked Embedded System" forms a complete 
15 digital video surveillance system 10. 

If desired an encryption system may be utilized to secure the transmission. An 
example of such an encyption system relies on the correct delivery of a secret key triple 
to all recipients. A centralized key distribution server is suitable for this purpose. 

20 Secure transfer of the key triple can be accomplished by any one of the standard 
mechanisms as described by Steiner et al. (J. G. Steiner, B. Clifford Neuman, and J. I. 
Schiller, "Kerberos: An Authentication Service for Open Network Systems", 
Proceedings of the Winder 1988 Usenix Workshop on Workstation Security, Portland, 
OR, August, 1988), Garfinkel (Simson Garfinkel, PGP: Pretty Good Privacy, O'Reilly & 

25 Associates, 1994), and US Patent Number 5,214,706 to Minde (additional information 
found at http://www.ascom.ch/infosec), which is hereby incorporated by reference in 
its entirety, including any public key authentication and encryption techniques, or any 
other suitable technology. The key triple is determined by the multimedia data source 
and registered in a secure way to the key server. At any time, the key triple can be 

30 updated by the data source. A recipient can request the key triple from the server at 
any time and use the key triple to decode any multimedia data messages. The key 
triple is therefore time-variant. 

The present method also relies on a pseudo random number generator (e.g. see 
Knuth, Donald, The Art of Computer Programming, Volume 2: Seminumerical 

35 Algorithms, 3 rd edition, Addison-Wesley, 1998), that is known to the data source and 
all recipients. One could employ a pseudo number generator with pre-defined 
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parameters, or one could rely on the key server to distribute that information to all 
recipients. The parameters that characterize the generator need not be kept secret. Yet, 
the generator must indeed generate pseudo random numbers with a very large period. 
Furthermore, the sequence must be reproduced in a deterministic manner. 

5 Let us denote the pseudo random generator by G(£). Thus, if the current 

random number is k, then the next number in the sequence in G(/c). The application of 
the generator to k for n times is denoted by G n (k). The relative positional index of G n (k) 
with respect to k is n. The key triple is defined by (a,b,p) where a is the fixed index key, 
b is a random number within the pseudo random number sequence, and p is the relative 

10 index of b with respect to the initial random number. The initial selection of the triple is 
done at the data source, a is chosen according to the selected strong cipher mechanism 
(e.g., see Minde) and kept fixed throughout the session, b can be generated randomly as 
long as it belongs to the pseudo random sequence defined by G(£). The initial value for 
p is zero. 

15 The multicast multimedia data is grouped into variable length messages, each 

encrypted by a variable key. Denoted by XOR(v,u), the encryption of a message (i.e., a 
byte sequence) v using a key u is done by laying out the bytes of u periodically into an 
infinite sequence of bytes and applying it against v using the XOR operation. 
Decryption is done easily by the same operation. Each message is preceded by an 

20 encrypted index. The index must be encrypted by a strong cipher mechanism such as 
that described in Minde. We shall denote the encrypted index by Z(i) where i is the 
unencrypted index. 

The multicast source encrypts the message by first selecting an initial random 
number and setting the initial index to zero. Then an incremental index D is selected 

25 randomly from the integer set [0,l,...MaxIndex] according to a uniform distribution. 
The previous random number is passed through G(£) for D number of times to yield 
the current random number. This current random number will be the key used to 
encode the current message. The absolute index, that is, the accumulation of all the 
incremental indices, will be encrypted using the strong cipher Z(£). For transmission, 

30 the encrypted index and the encrypted message is concatenated and transmitted. 

Once a message has been received, it is decrypted. The absolute index is first 
decrypted using the inverse of Z(£), and then the random number used to encrypt the 
message is calculated. This calculation can be done quickly from the last known index 
and random key pair. This applies even when there is message loss. In the worst case 

35 where a receiver may have lost all the transmitted messages (e.g., a receiver happens to 
start the reception when the session is already in progress), the receiver can compute 
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the current random key by passing the initial random key through G(£) according to 
the absolute index. Unfortunately, the absolute index can be very large and require a 
lot of computations. To reduce this computation, it is recommended that the multicast 
source update the current index and random key pair on the key distribution server 
5 periodically. Thus, receivers that have lost the encryption key can always obtain the 
last registered key triple from the server and limit the computations needed to obtain 
the current key. 

If desired a motion detection system may be utilized to determine whether an 

10 alarm, a recording or other action is necessary. An example of a motion detection 
system used for H.263 bitstream syntax is based on the Discrete Cosine Transform 
(DCT) compression with motion estimation and prediction. Pictures are partitioned 
into a number of macro-blocks (MB). Some pictures are encoded in the INTRA mode 
but the majority in INTER mode. In INTRA mode, a picture is encoded without 

15 prediction and motion estimation. This serves as an anchor for decoding subsequent 
INTER coded frames. For INTER coded pictures, motion estimation and prediction are 
used. For motion estimation, each MB is compared against the previous picture within 
a search range centered around the current MB to find the best match. Once the best 
match is found, the difference between the current MB and the best match is computed. 

20 This difference is transformed into the frequency domain using DCT. The spectral 
components of the DCT output are quantized and encoded using Huffman or 
Arithmetic encoding. The resulting bits from each MB compression are packed and 
wrapped with header information to form the data stream of one compressed picture. 
Multiple compressed picture streams are concatenated to form a typical H.263 encoded 

25 bit stream. 

For a motionless scene, all INTER picture will have all MBs unencoded, resulting 
in a minimum number of bits per picture. In fact, in a perfect environment with no 
noise, this is a necessary and sufficient condition for non-motion. In reality, the capture 
and encoding processes are subject to noise. Environmental noise such as changes of 
30 sunlight, small vibrations, changes in temperature, etc., can all contribute to perceived 
motion by the camera. Furthermore, the analog-to-digital capture process introduces 
A/D noise. Finally, one major source of noise is in the compression process, where the 
DCT coefficients are quantized according to a given quantizer to achieve high ratio but 
lossy compression. 

35 The motion detection method described below is based on empirical 

observations that even though there are different sources of noise that would create 
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deviation from the ideal scenario, the noise disturbance remains a perturbation from the 
ideal case. 

The method utilizes the H.263 bitstream syntax as described in "Video Coding 
for Low Bitrate Communication/ 7 For an INTRA coded picture, no motion detection is 
performed. For an INTER coded picture, the bit stream is parsed to obtain the 
following values: 

I = number of INTRA coded MB 

M = number of INTER coded MB with non-zero motion vector 
M'= number of INTER coded MB with zero motion vector 
K' = number of non-coded MB 
T = total number of MB 

To obtain these values, one must parse the whole picture layer bitstream. 
However, the inverse quantization, inverse DCT and image reconstruction can be 
skipped. By skipping the unnecessary processing, the computation burden is greatly 
reduced. 

Once the above key values are obtained, we use a number of successive criteria 
to determine whether motion has taken place. Ideally, there is no motion if and only if 
I=M=M'=0 and K'=T. However, due to noise disturbance, we must modify the criteria 
to deal with non-ideal situations. The criteria are based on a number of user-defined 
thresholds. 

First, if I/T > 1-a, a declaration of non-motion is given because there are not 
enough representation of motion estimated MBs. a is preferably a small positive 
number. The smaller the number, the lower the tolerance for motion. If the first 
criterion is not met, then if M/(M+M'+K) > b, then a declaration of motion is given 
because there is sufficient non-zero motion vectors to indicate motion, b should be a 
fairly small positive number. If the second criterion is not met, then the average bits 
used to encode a macro-block in this picture is computed, and if this value exceeds 1+g, 
then a declaration of motion is given. The last criterion is designed to cope with 
encoders that are not very good at motion estimation. For these encoders, it is possible 
to have many MB coded with zero Motion Vector, but the total number of bits used to 
encode each MB must be correspondingly high if there is indeed motion, g can be any 
positive value. 
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CONCLUSION 

The uniqueness of the Networked Client/ Server Embedded Backbone System is 
a combination of its networking feature, operating system remote booting feature, 

5 application software pushing feature, central control and communication software 
feature, central manageability, flexibility, ease of use and scalability. 

The networked embedded Backbone System is different from other embedded 
system by its integration of three methods: remote booting of a highly sophisticated 
operating system from a central server instead of utilizing an EPROM-based f unction- 

10 limited OS, application software for the embedded system is pushed from a central 

server onto the RAM device of this system instead of being programmed on an EPROM 
device and a common layer of communication and control software is provide on each 
networked embedded system allowing inter-module controls from the central server to 
each individual embedded system. 

15 Although the examples given include many specificities, they are intended as 

illustrative of only a few possible embodiments of the invention. Other embodiments 
and modifications will, no doubt, occur to those skilled in the art. Thus, the examples 
given should only be interpreted as illustrations of some of the preferred embodiments 
of the invention, and the full scope of the invention should be determined by the 

20 appended claims and their legal equivalents. 
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What is claimed is: 

1 1. A method for creating and using a networked embedded backbone computer 

2 system, comprising the steps of: 

3 (a) booting over a network an operating system onto a plurality of embedded 

4 systems; 

5 (b) pushing selected application software onto said plurality of embedded 

6 systems from a central server; 

7 (c) and communicating between said plurality of embedded systems and said 

8 central server. 

1 2. The method of claim 1 wherein step (a) is performed by booting from said 

2 central server. 

1 3. The method of claim 1 wherein step (a) is performed by the steps of: 

2 (a) creating a footprint of a Boot ROM program within one of said embedded 

3 systems; 

4 (b) locating a boot server connected to said network; 

5 (c) requesting loading of the boot image filed from said boot server; 

6 (d) transferring a selected boot image file to said embedded system; 

7 (e) transferring a final footprint of a selected operating system; 

8 (f) and executing the selected operating system on said embedded system. 

1 4. The method of claim 3 wherein said boot image file is selected based on a 

2 unique designation from said embedded system. 

1 5. The method of claim 4 wherein said unique designation is a media access 

2 control address located on a network interface card. 

1 6. The method of claim 3 wherein said Boot ROM program is created on a 

2 motherboard. 

1 7. The method of claim 3 wherein said Boot ROM program is created on a 

2 network interface card. 
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1 8. The method of claim 1 wherein further communication occurs between said 

2 plurality of embedded systems. 

1 9. The method of claim 1 wherein step (c) is performed using a central control 

2 communication software layer. 

1 10. The method of claim 9 further comprising the step of utilizing said central 

2 control communication software layer to send a notification to said central 

3 server. 

1 11. The method of claim 10 wherein said notification informs said central server 

2 of one of said plurality of embedded systems being ready to receive booting 

3 information. 

1 12. The method of claim 10 wherein said notification includes information about 

2 capabilities of one of said embedded systems. 

1 13. The method of claim 1 wherein said central server controls said plurality of 

2 embedded systems. 

1 14. The method of claim 1 wherein said networked embedded backbone 

2 computer system is used as a digital surveillance system. 

1 15. The method of claim 14 wherein at least one of the embedded systems is a 

2 surveillance camera and wherein said surveillance camera is monitoring a 

3 location. 

1 16. The method of claim 15 further comprising the step of testing information 

2 received from said surveillance camera for motion. 

1 17. The method of claim 16 wherein an alert is activated when motion is detected, 

l 18. The method of claim 1 wherein the communications of step (c) are encrypted. 

1 19. A method of encrypting data, comprising the steps of: 

2 (a) selecting an initial random number; 
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3 (b) setting the initial index to zero; 

4 (c) randomly selecting an incremental index from an integer set 

5 [0,1,. . .Maxlndex] according to a uniform distribution; 

6 (d) passing the initial random number through G(£) for a number of times 

7 equal to the incremental index to yield a current random number; 

8 (e) and using the current random number as a key to encode a current 

9 message. 

1 20. The method of claim 19 further comprising the steps of: 

2 (f) repeating step (e) to create successive random number indices to 

3 encode successive messages. 

1 21. The method of claim 20 further comprising the steps of: 

2 (g) creating an absolute index from an accumulation of the initial number 

3 index and the successive random number indices; 

4 (h) encrypting the absolute index using a strong cipher Z(£); 

5 (i) concatenating the encrypted index and the encrypted message; 

6 (j) transmitting the encrypted index and the encrypted message. 

1 22. The method of claim 21 further comprising the steps of: 

2 (f) decrypting the absolute index using the inverse of Z(£); 

3 (g) calculating the random number used to encrypt the message; 

4 (h) and decrypting the message. 

1 23. A method for detecting motion in a bitstream having an H.263 syntax to 

2 return a state of motion or a state of non-motion, the method comprising the 

3 steps of: 

4 (a) parsing the bitstream to obtain a set of values; 

5 (b) obtaining an I value equal to a number of INTRA coded macro-blocks; 

6 (c) obtaining an M value equal to a number of INTER coded macro-blocks 

7 with a non-zero motion vector; 

8 (d) obtaining an M' value equal to a number of INTER coded macro-blocks 

9 with a zero motion vector; 

10 (e) obtaining an K* value equal to a number of non-coded macro-blocks; 

1 1 (f) obtaining an T value equal to a total number of macro-blocks; 

1 2 (g) selecting a value for a; 
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13 (h) calculating I/T and 1-a; 

14 (i) when I/T is greater than 1-a, declaring the state of non-motion. 

1 24. The method of claim 23 further comprising the steps of: 

2 (j) selecting a value for b; 

3 (k) calculating M/(M+M'+K); 

4 (1) when M/(M+M'+K) is greater than b, declaring the state of motion. 

1 25. The method of claim 24 further comprising the steps of: 

2 (m) selecting a value for g; 

3 (n) calculating an average of bits used to encode the INTER coded macro- 

4 blocks; 

5 (o) when the average of bits is greater than 1+g, declaring the state of 

6 motion. 
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